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This paper describes the structure and activities of READ (Reading Effectively Across the 
Disciplines), a pilot initiative to improve students' critical reading skills, disciplinary literacy 
and academic success. READ employs a multimodal design that consists of faculty training 
in disciplinary literacy instruction and curricular enhancement, development and 
implementation of active reading assignments and assessments, peer-led team learning, and 
the dissemination of discipline-specific teaching and learning resources on an Open Lab site to 
provide an interactive teaching and learning environment for students and faculty. Empirical 
evidence of the initial effectiveness of the pilot in three gateway courses in Biology, 
Electromechanical Engineering Technology, and Marketing showed improvement in student 
pass rates after implementation of reading strategies and instructional approaches that guide 

students through the reading process. 

College reading requires skills and strategies that differ from those required 
for high school reading in many ways. Even though college and high school courses 
may carry similar titles, college courses are more challenging due to a larger amount 
of material covered, demanding learning goals, and more diverse and complex reading 
requirements (Conley 2007,2008; Conley, Aspengren, Stout, & Veach, 2006). Given the 
greater breadth and depth of content knowledge taught in college courses, students 
need a series of advanced thinking and learning skills, both general and discipline- 
specific, to succeed. 

Among these skills are effective textual engagement and deep understanding 
of texts, which require inferential and elaborative processing (Graesser, Millis, & 
Zwaan, 1997; Kintsch & Rawson, 2005; Pressley & Afflebach, 1995). Evidence suggests 
that students generally do not develop these skills extensively in high school (Conley 
et al., 2006). Studies in cognitive developmental processes indicate that students are 
still acquiring the ability to use and understand adverbial conjuncts and idiomatic 
interpretation late in high school (Chapman, 1983; Nippold & Martin, 1989). In 
addition, inferential reasoning, abstract thinking, and recognition and use of 
structure/features, are developed only with maturity and experience (Chambliss, 1995; 
Kletzien, 1992). As Conley (2007) points out, in college courses, 

students are expected to make inferences, interpret results, analyze conflicting 

explanations of phenomena, support arguments with evidence, solve 
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complex problems that have no obvious answer, reach conclusions, offer 
explanations, conduct research, engage ideas, and generally think deeply 
about what they are being taught, (p. 6) 

These are the thinking and reasoning skills that students may not readily 
possess and apply while reading as they enter college. Another challenge that they 
face is their lack of background knowledge of both content and structure (Moore & 
Scevak, 1997), especially for certain discipline-specific and discipline-related texts. 

From the perspective of disciplinary literacy education, the question is not 
whether reading should be taught, but what, how, and where it should be taught in 
college, and who should be involved in the process. College reading is discipline- 
specific (Fang & Schleppegrell, 2010; Shanahan & Shanahan, 2008) and literacy varies 
in different domains (Alexander, Schallert, & Hare, 1991). Disciplinary literacy is 
characterized by "the ways of thinking, knowing, and doing that are consistent with 
each discipline," rather than by "a set of strategies instructors use to help students 
organize text or make connections among words" (Zygouris-Coe, 2012, para. 2). In this 
sense, reading, as disciplinary literacy, should be taught not just in English courses, 
contrary to the perception of many, but also in the content areas. Content area faculty 
should make reading requirements clear, understand their students' ability, and 
introduce strategies to facilitate discipline-specific thinking and critical reading of text 
material. It is important to know that they are not expected to teach students to learn 
to read, but to read to learn in the disciplines (Richardson, Morgan & Fleener, 2012). 
Lastly, college reading requires faculty to engage students by using relevant 
assessments and approaches to enable them to develop their own strategies while 
reading in the disciplines and become independent readers. 

Development of the READ program 

Two institutional challenges framed the development of the READ program: 
(1) a college-wide general education reading assessment, which suggested that over 
70% of students were found to struggle with college-level reading, much greater than 
the national average of 52% (ACT, 2012), and: (2) a university funding opportunity to 
develop, implement and evaluate student success initiatives to increase pass rates in 
gateway courses where over 100 students failed in Fall 2011. Our proposal included 
funding to develop and implement professional development initiatives for faculty to 
cultivate the skills to enhance students' reading skills in various disciplines through 
collaborative effort between reading and content area faculty, disseminate developed 
curricular materials, provide student stipends for peer led team learning, and assess 
activities. In Fall 2012, we were awarded funding. From Spring 2013 to Spring 2014, 
we focused on enhancing student performance in three gateway courses — Biology I 
(BIO 1101), Essentials of Marketing (MKT 1100), and Electromechanical Manufacturing 
Laboratory (EMT 1130), all with more than 100 students not successfully completing 
the course (withdrew or failed) in Fall 2011. 

This paper describes the structure and activities of READ. We hypothesized 
that our students' low level of college readiness in reading was due to their lack of 
vocabulary skills and the active reading strategies needed to become effective readers 
and learners in the disciplines. Instead of engaging in reading-to-learn, struggling 
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readers often rely on their listening skills in class (Schemo, 2006). Even for students 
who read their text, many only accumulate facts and memorize correct answers while 
not able to engage with the text and practice the metacognitive thinking needed. We 
further hypothesized that effective instruction of active reading strategies and 
vocabulary skills in the content areas would improve students' general and discipline- 
specific reading and thinking skills and enable them to become independent readers, 
and thereby achieve greater success in their courses. While focusing mainly on 
delivering content knowledge, instructors across the disciplines often overlook the 
importance of reading proficiency and do not feel ready to address the challenges 
students face in reading text material (Hall, 2005; Stewart and O'Brien 1989). It is also 
common that faculty across the disciplines lack instructional and assessment strategies 
that scaffold reading assignments to guide students through the reading-to-learn 
process. 

As our college is an open access, public, minority serving institution, we 
further hypothesized that by incorporating evidence-based practices, such as peer led 
team learning (PLTL), we would further advance our goal to improve pass rates. With 
PLTL, more advanced, successful undergraduate students are trained as peer leaders 
to facilitate small group learning. These peer-led groups meet weekly, separate from 
the lecture and the instructor. Peer leaders do not provide answers, but instead ask 
leading questions to promote students working together to solve problems that are 
structured to help them develop conceptual understanding and problem-solving skills. 
PLTL has been demonstrated to lead to increased student success, particularly among 
minority students (Snyder, Sloane, Dunk, & Wiles, 2016). 

To test our hypothesis to improve our students' critical reading skills, 
disciplinary literacy and academic success, we embed literacy into content instruction 
to engage students in the reading-to-learn process within the discipline. The 
effectiveness of this approach relies on the practice that literacy specialists assist 
content area instructors to identify literary practices unique to their disciplines. As 
Moje (2008) suggests, "it may be most productive to build disciplinary literacy 
instructional programs, rather than to merely encourage content teachers to employ 
literacy teaching practices and strategies" (p. 96). As supported by research over the 
past decades, disciplinary literacy instruction is crucial to improving literacy skills and 
knowledge acquisition (Alexander & Jetton, 2000; Alvermann & Moore, 1991; Meltzer, 
2002 ). 


Method 

READ is a multi-component program in which reading and content area 
faculty work together to design discipline-specific reading strategies to improve 
student learning in selected courses. The four program components are faculty 
development, Peer-Led Team Learning (PLTL), reading assessments, and a READ 
Open Lab website. The activities involved in the implementation of READ are shown 
in Table 1. 
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Table 1 


Summary of READ activities 

Semester 

Faculty 

Peer-led 

Open Lab 

READ 


Development 

Team 

Learning 

(PLTL) 

READ site 

Assessment 

Spring 

-READ team 

-Recruitment 

- 

-Introductory 

2013 

planning 

of peer 

Development 

Workshop: 12 


-Introductory 

leaders in 

of discipline- 

participants 


Reading Across 

BIO 1100, 

specific 

from four 


the Curriculum 

MKT 1100, 

reading tasks 

departments. 


Workshop (led 

and EMT 

and teaching 

- College-wide 


by a reading 

1130 

strategies 

READ 


faculty from 



workshop: 


BMCC-CUNY). 



There were 14 


-College-wide 



participants 


READ 



from eight 


workshop to 



departments. 


recruit content 



-Baseline 


area faculty. 



reading 
assessment in 

selected BIO 

1101, MKT 1100, 
and EMT 1130 

sections 

Summer 

-READ faculty 

-Interviews 

-Setting up 

-Workshop: 16 

2013 

workshop for 

of peer 

READ Open 

participants. 


content faculty 

leaders in 

Lab Biology 



teaching BIO 

BIO 1101, 

site 



1101, MKT 1100, 

MKT 1100, 




and EMT 1130 

and EMT 

1130 



Fall 2013 

-Reading and 

-Peer leader 

-Continuous 

-Pre and post- 


content faculty 

training 

development 

reading 


met to discuss 

-Embedded 

of READ 

strategies 


implementation. 

PLTL 

Open Lab 

implementation- 


challenges, and 

workshops in 

Biology site 

assessments in 


modifications of 

one section of 


the areas of 


reading 

MKT 1100 (2 


comprehension. 


strategies and 

peer leaders); 


interpretation. 


assessment. 

and EMT 


context, and 



1130 (3 peer 

leaders); 

standalone 


analysis 
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Table 1 
Continued 


Semester 

Faculty 

Peer-led 

Open Lab 

READ 


Development 

Team 

Learning 

(PLTL) 

READ site 

Assessment 



workshops in 
one section of 
BIO 1101 (6 
peer leaders) 



Spring 

-READ spring 

-Peer leader 

-Completion 

-Workshop: 10 

2014 

workshop by 

training 

of READ 

participants 


content area 

-Embedded 

Open Lab 



faculty and peer 

PLTL 

Biology site; 

-Pre and post- 


leaders 

workshops in 

development 

reading 


-Reading and 

one section of 

of Open Lab 

strategies- 


content faculty 

MKT 1100 (3 

EMT site 

assessments in 


met to discuss 

peer leaders) 

-Setting up 

the areas of 


implementation. 

and EMT 

other content 

comprehension. 


challenges, and 

1130 (2 peer 

area sites to 

interpretation. 


modifications of 

leaders); 

be linked to a 

context, and 


reading 

standalone 

central READ 

analysis 


strategies and 

workshops in 

site 

-Survey of 


assessment 

one section of 


textbook 


-Presentation at 

BIO 1101 (3 


readability to 


the Computer 

peer leaders) 


inform design 


Engineering 

-Peer leaders' 


and 


Technology 

Conference 


implementation 


Dept. 

and poster 


of reading 



presentations 


strategies 

Summer 

-Presentations 




2014 

at the Teaching 
Professor 

Conference and 

the 

International 
Journal of Arts 
and Sciences 
Conference by 
two READ 
faculty 
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The program objectives for Fall 2013 and Spring 2014 were: 

1. Equip faculty of Biology I (BIO 1101), Essentials of Marketing (MKT 1100), 
and Electromechanical Manufacturing Laboratory (EMT 1130) with reading 
strategies and related teaching-practices 

2. Develop content specific assignments and teaching approaches for gateway 
courses to help students read and learn more effectively 

3. Implement READ Peer-Led Team learning (PLTL) student workshops to 
enhance learning in all three disciplines 

4. Evaluate the implementation of strategies — discipline specific reading 
assessments and teaching approaches in order to make future improvements 

5. Conduct a survey to get a better understanding of faculty and students' 
impression of the text 

Participants and Courses 

The READ Team included faculty members from the departments of English 
(Reading specialists). Biological Sciences, Computer Engineering Technology and 
Business, an education specialist in peer-led team learning, and the Associate Provost. 
The initial general education reading assessment was conducted in Spring 2012 by the 
college's Office of Assessment and Institutional Research, which also provided 
technical support for the program's assessment activities. In Fall 2013, READ 
participants included six Biology I sections - BIO 1101 (187 students), three Essentials 
of Marketing sections - MKT 1100 (133 students), and seven Electromechanical 
Manufacturing Lab sections - EMT 1130 (150 students) READ sections. In spring 2014, 
there were three BIO 1101 sections (139 students), one MKT 1100 section (34 students), 
and four EMT 1130 sections (76 students) READ sections. A total of 2 reading faculty 
members, 13 disciplinary faculty members, and 15 peer leaders participated in the 
program. Altogether, there were 34 READ sections, and 718 students served by the 
program during the 2013-2014 academic year. Due to budgetary/staffing limitations, 
some of the READ sections had no assigned peer leaders. 

Faculty Training 

To help launch the program, a literacy specialist trained several content area 
faculty members in reading strategies in Spring 2013. In Summer 2013 and Spring 2014 
additional workshops were offered in which the program principal investigator 
presented on the program background and instructional approaches to promoting 
active reading, the faculty liaisons gave discipline specific presentations, and the peer 
leaders presented on their findings and experiences. In addition, during these 
workshops, faculty worked in interdisciplinary groups to develop assignments that 
promote active reading. 

Discipline-specific Reading Strategies and Approaches 

In BIO 1101, several modifications were made to the course. First, the syllabus 
was modified to include the details of the reading assignments. Lecture slides w ere 
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also modified to improve readability and to include details of the reading assignments. 
Several assignments were developed to ensure that students read the syllabus and to 
assist with the structure and orientation within the textbook. A detailed reading 
objective outline was developed for the instructors along with a reading companion 
for the students. Several assignments were developed to engage students with the 
reading, some of which were also used as in-class active learning assignments. The 
assignments were categorized as pre-, during and post-reading assignments (Smyth, 
2014). Examples of all these materials are available on the biology Open Lab site 
(Smyth, 2013). 

In EMT 1130, numerous tools and processes were involved in assembling a 
digital trainer. To help students understand and retain information better, and 
visualize the steps more clearly, faculty designed feature analysis charts and process 
maps that were used as pre-lab assignments and assessment tools. These were used 
repeatedly in varying formats to reinforce learning using the lab manual. Pre-reading 
assignments were also implemented to relate students' background knowledge to 
technical information. Other reading and vocabulary activities were assigned to 
scaffold assignments and enhance students' understanding of technical vocabulary 
and connect concepts and analyze procedures (But, Kwon, & Laboy, 2015). 

In MKT 1100, marketing faculty chose to develop a series of engaging case 
studies for students to read and discuss in class. The selected case studies 
contextualized the concepts students learned in their lectures and textbooks. Low- 
stakes writing assignments were also designed to help students identify and analyze 
marketing strategies in the case studies, based on the lectures and textbook knowledge. 
Group discussions led by peer leaders also facilitated the application of concepts in real 
life examples. Students were also asked to define key terms to increase their 
professional vocabularies. 

Open Lab 

Open Lab is a web platform at the college previously launched through a Title 
V grant where faculty, staff and students can post materials and exchange ideas. The 
first Open Lab site was constructed for Biology (Smyth, 2013), also the most populated 
with content. It currently boasts 39 users from the City Tech community. An Open 
Lab site was also constructed for EMT 1130 (Laboy, 2014). Cengage, and the EMT 1130 
manual was self-published by some of the faculty. Responses to questions were on a 
four-point Likert scale: (1) Poor, (2) Fair, (3) Good, and (4) Excellent. 

Results and Discussion 

Over the Fall 2012 to Spring 2014 period, the READ initiative was established 
at City Tech. The four components of READ were implemented in stages over each 
semester (Table 1), resulting in a series of faculty development and training workshops, 
the training of peer leaders and piloting of PLTL reading workshops, several 
assessments of reading and an Open Lab website for READ to disseminate findings. 
Faculty were introduced to strategies and approaches to engage students in their 
reading. Faculty then developed discipline specific assignments and approaches that 
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best meet their needs. The activities of READ resulted in faculty and peer leaders 
trained in reading strategies, the development of discipline specific reading 
assignments and assessments and the dissemination of our findings both on the web 
through our Open Lab website and at conferences and meetings. It is notable to 
mention that the peer leaders also presented on their experiences locally and at national 
meetings. 

The READ initiative had several notable results. Pass rates increased in all 
three courses in both Fall 2013 and Spring 2014, compared to the non-READ sections 
in Fall 2011 (baseline data) as is shown in Table 2. 


Table 2 

Fall 2013 and Spring 2014 READ sections and Fall 2011 (non-READ) Grade/Pass Rate 
Comparison 


Fall 2011 

0/ 

/o 

0/ 

/o 

Spring 2014 

o/ 

to 

0/ 

to 

Fall 2013 

0/ 

/o 

0/ 

/o 

Non-READ 

Pass 

Pass 

READ 

Pass 

Pass 

READ 

Pass 

Pass 

Grade 

C or 

D or 

Grade 

C or 

D or 

Grade 

C or 

C or 

Distribution 

Better 

Better 

Distribution 

Better 

Better 

Distribution 

Better 

Better 

BIO 1101 

63.8% 

76.0% 

BIO 1101 

(3 sections) 

69.8% 

77.7% 

BIO 1101 

(6 sections) 

64% 

72% 


EMT 1130 

61.9% 

65.0% 

EMT 1130 

(4 sections) 

76.3% 

76.3% 

EMT 1130 

(7 sections) 

78% 

78% 

MKT 1100 

50.9% 

56.6% 

MKT 1100 

(1 section) 

61.8% 

64.7% 

MKT 1100 

(4 sections) 

81% 

82% 


For MKT 1100 the pass rate (A-D) improvement of READ sections compared 
to Fall 2011 non-READ sections was 25.4% (Fall 2013) and 8.1% (Spring 2014); the 
increase in students who achieved "A-C" was 30.1% (Fall 2013) and 10.9% (Spring 
2014). 

For EMT 1130, the pass rate (A-D) improvement was 24.4% (Fall 2013) and 
11.3% (Spring 2014); the increase in students who achieved "A-C" was 16.1% (Fall 2013) 
and 14.4% (Spring 2014). 

For BIO 1101, there was no increase in the percentage of students who 
achieved "A-D" and "A-C" or better in Fall 2013; the respective increases in students 
who achieved "A-D" and "A-C" in Spring 2014 were 1% and 6%, respectively. The 
authors feel that the relatively small increase in pass rate in BIO 1101 could be 
attributed to the fact that the lab and lecture sections of the course were not linked, and 
were therefore taught by different instructors. While reading strategies w ere 
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implemented in the lecture, PLTL could not be imbedded into the laboratory course 
and active reading was not reinforced. The final BIO 1101 grade is 60% lecture and 
40% lab. 

The results of the READ pre- and post-assessments in Fall 2013 for the three 
courses are shown in Figures 1 to 3. 


A 50 



Unable to comprehend the main Comprehends some main points Comprehends all mam points. Comprehends the text fully and able 
points; lacks vocabulary to and major details; draws basic details, and able to determine the to articulate the meaning 

summarize the information text/ Inferences to purpose of text/ meaning of vocabulary in context 

readi ng commu nlcates reading 


■ Pre-test 
- Post-test 


B 70 


60 


50 


41 



Unable to identify implied ideas that Identifies Implied Ideas but unable Understands inferences and draw Articulates implied meaning and 
are not directly stated in the text to draw meaningful conclusions meaningful conclusions generates cntlcal Insights 

from the text 


■ Pre-test 
- Post-test 


c 100 


90 

80 

7n 



Unable to Identify the progression Identifies at least one Idea or Identifies ideas or arguments but Demonstrates an ability to evaluate 
of the authors's Ideas or argument; argument but does not provide an does not provide a complete Ideas or arguments and an 

unable to evaluate or compare evaluation, struggles at comparing evaluation; demonstrates increasing advanced understanding to 
facts, positions and procedures or contrast Information between ability to compare and contrast compare or contrast information 
amongst various texts different sources Ideas or arguments to support the within and beyond the text 

understanding as a whole 


D 60 


50 


4i 40 



Unable to apply Information from Struggles to apple Information to a Applies information from the Proficiently applies information to 

the reading to a broader context broader context, but aware that it is reading to a broader context, broader contexts, both within and 

either within or outside of the useful and Important Indicating awareness that it is useful outside of the discipline 

discipline within the discipline 


■ Pre-test 
- Post-test 


Figure la-d. Results of Fall 2013 pre- and post-reading assessment for students in 
Computer Engineering Technology (CET). la. Assessment of comprehension in CET. 
lb. Assessment of context in CET. lc. Assessment of analysis in CET. Id. Assessment 
of interpretation in CET. Seven sections of the EMT 1130 course were assessed with 120 
students completing the pre-test and 79 completing the post-test. Total enrollment was 
150 students. 
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Unable to comprehend the main Comprehends some mam points Comprehends all mam points. Comprehends the text fully and able 
points: lacks vocabulary to and major details; draws basic details, and able to determine the to articulate the meaning 

summarize the information text/ Inferences to purpose of text/ meaning of vocabulary m context 

reading communicates reading 


■ Pre-test 
- Post-test 


B 70 
60 
50 


4> 



Unable to identify Implied ideas that Identifies Implied Ideas but unable Understands inferences and draw Articulates implied meaning and 
are not directly stated in the text to draw meaningful conclusions meaningful conclusions generates cntical insights 

from the text 


■ Pre-test 
Post-test 


C 100 


90 

80 



Unable to Identify the progression Identifies at least one Idea or Identifies ideas or arguments but Demonstrates an ability to evaluate 
of the authors's Ideas or argument; argument but does not provide an does not provide a complete Ideas or arguments and an 

unable to evaluate or compare evaluation; struggles at comparing evaluation; demonstrates increasing advanced understanding to 
facts, positions and procedures or contrast information between ability to compare and contrast compare or contrast information 
amongst various texts different sources Ideas or arguments to support the within and beyond the text 

understanding as a whole 


■ Pre-test 
Post-test 


D 


60 


SO 



U na ble to apply Information from Struggles to a pple Information to a Applies information from the Proficiently applies information to 

the reading to a broader context broader context, but aware that It Is reading to a broader context, broader contexts, both within and 

either within or outside of the useful and Important Indicating awareness that it is useful outside of the discipline 

discipline within the discipline 


■ Pre-test 
Post-test 


Figure 2a-d. Results of Fall 2013 pre- and post-reading assessment for students in 
Business (MKT). 2a. Assessment of comprehension in MKT. 2b. Assessment of context 
in MKT. 2c. Assessment of analysis in MKT. 2d. Assessment of interpretation in MKT. 
Four sections of the MKT 1100 course were assessed with 66 students completing the 
pre-test and 65 completing the post-test. Total enrollment was 133 students. 
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A 50 



Unable to comprehend the main Comprehends some mam points Comprehends all mam points. Comprehends the text fully and able 

points; lacks vocabulary to and major details; draws basic details, and able to determine the to articulate the meaning 

summarize the information text/ Inferences to purpose of text/ meaning of vocabulary in context 

reading communicates reading 


■ Pre-test 
- Post-test 


B 70 


60 


50 



Unable to identify Implied ideas that Identifies Implied Ideas but unable Understands inferences and draw Articulates implied meaning and 
are not directly stated In the text to draw meaningful conclusions meaningful conclusions generates cntlcal insights 

from the text 


100 
LIU 
80 
i 70 
? 60 
i 50 
i 40 
30 
2U 
10 
0 



Unable to Identify the progression Identifies at least one Idea or Identifies ideas or arguments but 
of the authors's Ideas or argument; argument but does not provide an does not provide a complete 
unable to evaluate or compare evaluation; struggles at comparing evaluation; demonstrates increasing 
facts, positions and procedures or contrast information between ability to compare and contrast 
amongst various texts different sources Ideas or arguments to support the 

understanding as a whole 


Demonstrates an ability to evaluate 
Ideas or arguments and an 
advanced understanding to 
compare or contrast information 
within and beyond the text 


■ Pre-test 
- Post-test 



D 


60 


50 



Unable to apply Information from Struggles to apple Information to a Applies information from the Proficiently applies information to 

the reading to a broader context broader context, but aware that it is reading to a broader context, broader contexts, both within and 

either within or outside of the useful and Important Indicating awareness that it is useful outside of the discipline 

discipline within the discipline 


Figure 3a-d. Results of Fall 2013 pre- and post-reading assessment for students in 
Biological Sciences (BIO). 3a. Assessment of comprehension in BIO. 3b. Assessment of 
context in BIO. 3c. Assessment of analysis in BIO. 3d. Assessment of interpretation in 
BIO. Four sections of the BIO 1101 course were assessed with 140 students completing 
the pre-test and 59 completing the post-test. Total enrollment was 186 students. 


Since the scopes and learning goals of the three target courses are different, 
the student populations also vary. EMT 1130 and MKT 1100 are required courses for 
Electromechanical Engineering Technology (AAS degree) and Computer Engineering 
Technology (BTech) and Marketing Management and Sales (AAS degree) and Fashion 
Marketing (AAS degree) majors, respectively; however, BIO 1101 is a course generally 
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... our faculty team used 
readings that meaningfully 
contextualize topics that 
were covered in class. 


taken as either an elective general education course for students of all majors or a 
required course for bioinformatics and health sciences students. 

The content of EMT 1130 is highly specialized and the only text used is the lab 
manual, which was also used in our pre- and post-assessments. Therefore, there was 
continuity and consistency between both sets of assessment. The assessment results in 
Fall 2013 demonstrated significant improvement in student reading. The increase in 
the percentage of students who met the criteria (3 or above) in comprehension, 
interpretation, analysis, and context ranged from 20 to 30%. 

MKT 1100 is a course that requires students to connect content knowledge to 
real life applications. MKT instructors selected case studies/articles to be used in class 
from several designated publications, from which we also selected passages for the pre 
and post-assessments. Even though the articles had different authors, their readability 
levels were similar and students were somewhat familiar to the structure and language 
used. The results showed moderate gain in student reading proficiency in the post¬ 
assessment. The increase in the percentage of 
students who met the criteria (3 or above) in 
comprehension, analysis, and interpretation were 6%, 

13%, and 10%. There was no marked improvement in 
context. Compared to EMT 1130 and MKT 1100, the 
reading requirements of BIO 1101, which consists of 
lecture (3 hrs) and lab (3 hrs), are broader and include diverse topics. The text is also 
conceptually dense and the chapters are longer when compared to those used in the 
other two courses. Therefore, students typically depend on lectures rather than 
reading to learn. For the reading assessments, our faculty team used readings that 
meaningfully contextualize topics that were covered in class. Newspaper articles with 
a research focus on biology were used. However, the selected articles varied in levels 
of complexity and requirements of background knowledge because of the nature of the 
topics and the manners in which the topics were discussed. While both readings in the 
pre-and post-assessments were college level, the pre-assessment was a factual report 
written in direct prose, and the post-assessment passage was based on a research report 
that consisted of complex ideas and arguments and therefore required more 
sophisticated cognitive skills and the use of context clues to understand general and 
technical vocabulary words. The assessment results also reflected that students found 
the post-assessment more challenging, not so much in understanding details and 
components in the text, as in making inferences and identifying and summarizing the 
overall main idea. As a result, the post-assessment showed improvement only in 
analysis, but not in comprehension, interpretation, and context. 

The textbook survey results were also intriguing. We note from data 
presented in Table 3 that BIO 1101 faculty and students in the READ section with peer 
leaders rated the textbook (from a commercial publisher) most highly, with the lowest 
rating by non-READ students. This implied that READ students were able to gain 
more value from the text and thus better appreciated it. The reverse trend is seen in 
EMT 1130 with EMT faculty and students in the READ section with peer leaders giving 
the self-published, non-peer reviewed manual the lowest rating. A quick review of the 
EMT manual revealed typos, misaligned drawings, inaccurate instructions, etc. 
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Faculty and READ students with peer leaders may have been most attuned to the 
manual's shortcomings. These errors in the manual have been addressed. 


Table 3 


Average Textbook Evaluation Survey Results 



BIO 1101 
Faculty 

BIO 

1101 

students 

READ 

with 

peer 

leaders 

BIO 

1101 

students 

READ 

no peer 

leaders 

BIO 

1101 

students 

non- 

READ 

EMT 

1130 

Faculty 

EMT 

1130 

students 

READ 

with 

peer 

leaders 

EMT 

1130 

students 

READ 

no peer 

leaders 

EMT 

1130 

students 

non- 

READ 

MKT 

1100 

Faculty 

Mdn 

3.19 

3.24 

2.9 

2.57 

2.89 

2.94 

2.99 

3.12 

2.7 

Resp. 










N of 

5 

30 

27 

13 

5 

15 

21 

10 

1 


Resp. 

Note. Evaluation rating scale: (1) Poor, (2) Fair, (3) Good, (4) Excellent 

As reflected in the faculty workshop feedback survey (see Appendix B), both 
full-time and part-time faculty participants found our workshop effective and were 
eager to apply the techniques they learned. From our observation, most of the 
participants were exposed to active reading strategies for the first time. Some of them 
also expressed interest in more in-depth discussion specific to their disciplines. This 
was done in subsequent meetings and collaborative activities throughout the semester. 

Limitations of the Study 

Improvements in grade distribution pre-READ (Fall 2011) to post-READ (Fall 
2013 and Spring 2014) were significant evidence of the success of this program. 
However, a detailed analysis of student characteristics was not made to confirm that 
these were appropriate comparison groups. It was just assumed that since the 
institution had not changed markedly, neither had the students. 

In order to assess students' reading proficiency in the target courses, the 
assessment tools used were not general and standardized, but discipline-specific. This 
presented a challenge to the faculty team who 
designed the assessment tools to ensure consistency 
between text complexities of the passages used and 
test items in the sets of pre- and post-assessments, 
although the same rubric was used in the process. 

While the same instructor rated the pre- and post¬ 
reading assessment results, another limitation of this study is that the resources to 
verify the reliability of the pre- and post-reading assessment tests were not available. 

Our initial plan was to embed peer-led team learning in class sessions. 
However, because of scheduling of CUNY first, the university's platform for course 


...most of the participants 
were exposed to active 
reading strategies for the 
first time. 
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scheduling and registration, BIO 1101 lecture and lab sections could not be linked as 
planned. As a result, different instructors taught lecture and lab sections. This caused 
difficulties in the implementation of PLTL workshops and grade analysis of the course. 
We observed that student attendance was not as satisfactory outside the scheduled 
class time as in embedded PLTL workshops. The lack of a uniform BIO 1101 final exam 
was another problem we faced in student assessment. 

Lastly, another limitation was sampling. There was a relatively low response 
rate on the textbook survey. 

Conclusions 

The multimodal design of READ provides an interactive teaching and 
learning environment. Instructors are equipped with active reading strategies and are 
able to design discipline-specific assignments that make reading necessary and 
relevant. Students are engaged in active reading in both individual and group settings. 
Peer led team-reading workshops facilitated by student peer leaders additionally 
supported students. 

The READ Open Lab site has been a useful resource for READ instructors. 
Populated with reading strategies, sample assignments and activities, the site also 
serves as a platform for exploring and sharing questions, feedback, and best practices. 

Even though reading is an essential part of learning in all disciplines, content 
area literacy has not been addressed in most content area classrooms. Given that 
faculty members in the disciplines are generally unfamiliar with the "reading to learn" 
approach, it took significant effort to recruit faculty participants. The reading faculty 
team conducted several college-wide workshops to share the importance of content 
area literacy instruction. Since most of the participating instructors were adjunct 
faculty, their levels of commitment tended to vary, mainly due to time constraints. The 
program's success relied on not only sound reading strategies and teaching 
approaches, but also faculty involvement and team communication in the 
implementation process. 

Presently, we continue our efforts to enhance our students' skills in "reading 
to learn" across the disciplines. We have expanded our focus on improving student 
reading to include additional disciplines including Architectural Technology, Dental 
Hygiene, Accounting, and Mathematics Education in 2015-2016. 
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Appendix A 

Reading Assessment Rubric 


Performance 

Criteria 

Does Not 

Meet 

Criterion 

Approaching 

Criterion 

Meets 

Criterion 

Surpasses 

Criterion 

Comprehension 

Unable to 
comprehend 
the main 
points; lacks 
vocabulary to 
summarize the 

information 

text/reading 

communicates 

Comprehends 
some main 
points and 
major details; 
draws basic 

inferences to 
purpose of 
text/reading 

Comprehends 
all main 
points, details, 
and able to 

determine the 
meaning of 
vocabulary in 
context 

Comprehends 
the text fully 
and able to 

articulate the 
meaning 

Context 

Unable to 
apply 

information 

from the 
reading to a 
broader 

context either 

within or 

outside of the 
discipline 

Struggles to 
apple 

information to 

a broader 
context, but 
aware that it 

is useful and 
important 

Applies 

information 

from the 
reading to a 
broader 

context, 
indicating 
awareness that 

it is useful 

within the 
discipline 

Proficiently 

applies 

information to 

broader 
contexts, both 
within and 

outside of the 
discipline 
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Analysis 

Unable to 
identify the 
progression of 
the author's 

ideas or 
argument; 
unable to 

evaluate or 
compare facts, 
positions and 
procedures 
amongst 
various texts 

Identifies at 

least one idea 
or argument 
but does not 
provide an 
evaluation; 
struggles at 
comparing or 
contrast 

information 

between 

different 

sources 

Identifies ideas 
or arguments 
but does not 
provide a 
complete 
evaluation; 
demonstrates 
increasing 
ability to 
compare and 
contrast ideas 
or arguments 
to support the 
understanding 
as a whole 

Demonstrates 
an ability to 
evaluate ideas 
or arguments 
and an 

advanced 
understanding 
to compare or 

contrast 

information 

within and 
beyond the 
text 

Interpretation 

Unable to 

Identifies 

Understands 

Articulates 


identify 

implied ideas 

inferences and 

implied 


implied ideas 

but unable to 

draw 

meaning and 


that are not 

draw 

meaningful 

generates 


directly stated 
in the text 

meaningful 

conclusions 

from the text 

conclusions 

critical insights 


Appendix B 

READ Faculty Workshop Feedback Survey (August 2013) 

1. Which of the following best describes your position at City Tech? 


Number of Responses: 15 


Full-time faculty 

Part-time faculty 

Administrator/Staff 

3 

11 

1 

20.00% 

73.30% 

6.70% 


2. Please indicate your department /program/area affiliation: 


Number of Responses: 13 


Biology 

6 

Business/Marketing 

3 

Computer Engineering Technology 

4 


3. For the following statements, please indicate your level of agreement: 
Number of Responses: 15 
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Strongly 

Agree 

Moderately 

Agree 

Neutral 

Moderately 

Disagree 

Strongly 

Disagree 

Mean 

Overall Average 

94.1% 

5.9% 




4.94 

The 

program/workshop 
was well organized. 

15 






100% 





5.00 

The presenter's 
knowledge of the 
content contributed 
to my 

understanding of 
the material. 

15 





5.00 

100.00% 






The presenter's 
ability to 

communicate to my 
understanding of 
the material. 

14 

1 




4.98 

100.00% 

6.7% 





The 

program/workshop 
content was 

consistent with the 
description of the 
announcement. 

15 





5.00 

100.00% 






The material 
presented was 
useful for my 
professional 
development. 

14 

1 




4.98 

93.00% 

6.7% 





In general, I was 
satisfied with the 

content of the 
program/workshop. 

14 

1 




4.98 

93.30% 

6.7% 






48 


Volume 12 • 2017 























The 

program/workshop 
met or exceeded my 
expectations. 

12 

3 




4.80 

80.00% 

20.00% 





I would 

recommend this or 

other similar 
programs to my 
colleagues. 

14 

1 




4.98 

93.30% 

6.7% 
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